Learning from the Reactions of the Outside World